NONCONGRUENCE SUBGROUPS IN H(2) 
PASCAL HUBERT AND SAMUEL LELIEVRE 

Abstract. We study the congruence problem for subgroups of 
the modular group that appear as Veech groups of square-tiled 
surfaces in the minimal stratum of abelian differentials of genus 
two. 
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1. Introduction 

Let io be a holomorphic 1-form on a compact Riemann surface X. If 
there exists a branched covering / : X — > T 2 = R 2 /Z 2 , ramified only 
over the origin of T 2 , such that f*{dz) = u, the flat surface (X, \u\) is 
tiled by squares whose vertices project to the origin of the torus, and 
(X, uS) is called a square-tiled (translation) surface. 

In each genus g, square-tiled surfaces are the integer points of the 
moduli space 7i g = QAi g of holomorphic 1-forms on Riemann surfaces 
of genus g. This space is stratified by the combinatorial type of zeros, 
and each stratum is a complex orbifold endowed with an action of 
SL(2, R). Orbits for this action are called Teichmuller discs. 

The main problem in dynamics in Teichmuller spaces is to under- 
stand this SL(2, R)-action, and to obtain Ratner-like classification re- 
sults for its orbit closures and its invariant closed submanifolds. 
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The first step is to determine as many invariant closed submanifolds 
as possible. The simplest of them are closed orbits. These are the orbits 
of translation surfaces with finite-covolume stabilisers, called Veech sur- 
faces because of Veech's pioneering work jVej . These Teichm tiller discs 
project to geodesically embedded curves, called Teichmiiller curves, in 
the moduli space M. g of complex curves of genus g. These curves are 
uniformised by the stabiliser of the corresponding SL(2, R)-orbit. 

Square-tiled surfaces are Veech surfaces. They already appeared in 
Thurston's work on the classification of surface diffeomorphisms, see 
FLP, expose 13]. Nevertheless up to recently their Teichmiiller discs 
have been little discussed, due to the difficulty of proving precise state- 
ments about them. The only classical result is Gutkin and Judge's 
theorem |GuJuj which states that the corresponding stabilisers are 
arithmetic (commensurable to SL(2, Z)). Very recently the Teichmiiller 
discs of square-tiled surfaces were studied into more detail, see [HL , 
Mill, HEj, jSchmij . 

A square-tiled surface (X, u) is called primitive if the lattice of rel- 
ative periods of uj is Z 2 (in other words the covering (X, u) — > (T 2 , dz) 
does not factor through a bigger torus). In this case, the stabiliser, 
denoted by SL(X,u), is a (finite-index) subgroup of SL(2,Z). 

In order to give the most accurate description of Teichmiiller discs 
of square-tiled surfaces, we investigate these subgroups. In the theory 
of subgroups of SL(2, Z), a natural and important question is the con- 
gruence problem. This question is the central object of this paper: we 
give a negative answer in the stratum 7Y(2) = QAi 2 (2) of 1-forms on 
genus 2 surfaces having one double zero. 

Recent results about square-tiled surfaces in 7~C{2). The dis- 
crete orbit SL(2, Z)-(X, uj) of a primitive square-tiled surface (X, uj) 
consists of all the primitive square-tiled surfaces in its Teichmiiller 
disc SL(2, R)-(X, uj); indeed, SL(2, Z) acts on primitive square-tiled 
surfaces, preserving the number of squares. Understanding the Te- 
ichmiiller discs or the discrete orbits of primitive square-tiled surfaces 
is therefore equivalent. We will use the following result about the dis- 
crete orbits of primitive square-tiled surfaces in Ti.(2). 

Theorem A. Primitive n- square-tiled surfaces in the stratum 71.(2) 
form: one orbit A 3 if n = 3; two orbits A n and B n if n is odd ^ 5; one 
orbit C n if n is even. 

This was shown for prime n in |HLj . and conjectured for arbitrary 
n; the conjecture was proved in full generality in |Mc4j . 
Let r^ n , T Bn and T Cn denote the stabilisers of these orbits. 
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Remark. The indices of the groups Ta„, ^b„, ^c n in SL(2, Z) are the 
cardinalities a n , b n , c n of the discrete orbits A n , B n , C n . 

Eskin-Masur-Schmoll [EsMaSc] give a formula for the number of 
primitive n-square-tiled surfaces in 7i(2): 

Theorem B. The number of primitive n- square-tiled surfaces in 7i(2) 
»i(n-2)» 2 IIp|„(l-£). ' 

Remark. Throughout this paper, the letter p always denotes prime 
numbers; in particular, Yl p \ n i s the product over prime divisors of n. 

This formula gives c„ (and a 3 ) when there is one orbit and a n + b n 
when there are two. We conjectured in [HLJ: 

Conjecture 1. For odd n ^ 5 ; a n and b n are given by: 

a n = ±(n- IK n p ,„(l - £), b n = £(n - 3)n 2 [1^(1 - £)■ 

Statement of results. In this paper, we show: 

Theorem 1. For all even n ^ 4 ; r<7 n zs a noncongruence subgroup. For 
all odd n ^ 5 satisfying Conjecture^ and are noncongruence 
subgroups. 

Remark. Conjecture ^ is proved up to n = 10000 by an explicit combi- 
natorial computer calculation. 

Corollary 1.1. Under Conjecture QJ, the only primitive square-tiled 
surfaces in 7Y(2) whose stabiliser is a congruence subgroup are those 
tiled with 3 squares. 

Corollary 1.2. Under Conjecture^ of all the Teichmuller curves em- 
bedded in A4. 2 that come from orbits in 7~t{2), only one is uniformised 
by a congruence subgroup o/SL(2,Z). 

Remark. For n = 3, Ta 3 is the level 2 congruence subgroup 6 generated 
by and (of), named after its link to the Jacobi Theta function. 

Link with the Hurwitz problem. An essential ingredient in our 
proof of Theorem Q is the knowledge of the indices in SL(2, Z) of T^ n , 
T Bn and T c „ (given by Theorem FBI and Conjecture [TJ). 

Since these indices are the cardinalities of the discrete orbits A n , 
B n and C n , finding these numbers is a variant of Hurwitz's problem, 
which consists in counting the number of branched covers of a fixed 
combinatorial type (number and multiplicity of ramification points) 
and fixed degree of a Riemann surface S. A very detailed survey of 
this subject can be found in the introduction of Zvonkine's thesis jZvj . 
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When S is the torus T 2 = R 2 /Z 2 (or more generally an elliptic 
curve), it can be endowed with the 1-form dz. Hurwitz's problem 
amounts to counting the number of coverings (with fixed combinatorial 
type) / : (X,oS) — > (T 2 ,dz) where u = f*(dz). For a fixed combinato- 
rial type c, denote by h njC the number of such coverings, weighted by 
the inverse of their number of automorphisms. 

We have the following fundamental theorem: 

Theorem C. For any combinatorial type, the generating series F c (z) = 
YlhLi hn,c (p , where q = e 2l7TZ , is a quasi-modular form of maximal 
weight 6g — 6. 

This theorem was first proved in the case of simple ramifications by 
Dijkgraaf [Dlj and Kaneko-Zagier |KaZaj : the general proof relies on 
results of Bloch-Okounkov [BlOk], see |EsOkj . 

The quasi-modular form is explicitated by Kani |Kaj and by Eskin- 
Masur-Schmoll [EsMaScJ in particular cases. Some generalisations are 
proved by Eskin-Okounkov-Pandharipande [Es OkPaj . 

Note also that the asymptotics of the countings of square-tiled sur- 
faces of bounded area serve to compute the volumes of strata (see |Zo| , 
|ECTj ). 

Acknowledgements. We thank Gabriela Schmithusen for the inspira- 
tion and useful discussions, and Giovanni Forni for encouraging this 
research. 

2. Background 

2.1. Square-tiled surfaces, action of SL(2,Z), cusps. We recall 
here some tools used in |HLj . to which we refer for more detail. 

The modular group T(l) = SL(2,Z) acts on primitive square-tiled 
surfaces, preserving the number of squares tiles. Indeed, the property 
of having Z 2 as lattice of relative periods is SL(2, Z)-invariant. 

Given a primitive square-tiled surface (X,u), its stabiliser SL(X, uj) 
is a finite-index subgroup of SL(2, Z), therefore the curve SL(X, u;)\H 
is a branched cover of the modular curve SL(2, Z)\H, and the degree 
of the cover is the index of SL(X, uj) in SL(2, Z). 

The modular group is generated by any two matrices among (J[), 
( \ 5 ) and (1~q). Denote by U the sub group generated by ( \ \ ) . 

Cusps. The cusps of SL(X, c<j)\H are classified combinatorially by 
the following lemma. 

Lemma 2.1 (Zorich). Let (X,u) be a primitive square-tiled surface. 
There is a 1-1 correspondence between the set of cusps of SL(X, u;)\H 
and the U -orbits of SL(2, Z)-(X, uj). 
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Any square-tiled surface decomposes into horizontal cylinders, which 
are also square-tiled, and bounded by unions of saddle connections of 
integer lengths. This provides a way to give coordinates for square-tiled 
surfaces in each stratum (see below for the stratum 7i(2)). 

The action of the generators (o i) an d (? V) °f SL(2, Z) is easily 
seen in these coordinates: ( ? "q 1 ) exchanges the horizontal and vertical 
directions; (J}) only changes the twists. 

The width of a cusp is given by the cardinality of the corresponding 
W-orbit. If the horizontal cusp has width £, the primitive parabolic in 
the horizontal direction is (J J). Considering how the cylinders behave 
under the action of U, we get the following lemma. 

Lemma 2.2. If a primitive square-tiled surface decomposes into hori- 
zontal cylinders Ci of height hi and width Wi, then its (horizontal) cusp 
width equals the least common multiple of the h ^ w , possibly divided by 
some factor. 

Notation. Here, and in the sequel, aAb denotes the greatest common 
divisor of two integers a and b. 

The following example illustrates the case of division by a factor. 
This surface is in 7i(l, 1) and has a nontrivial transla- . d . c m b 
tion by the vector (2, 0); though it is made of one cylin- 



der of height 1 and width 4, its cusp width is only 2. abed 

In the stratum 7i(2) on which we will focus from now on, this situ- 
ation does not occur. 

2.2. Square-tiled surfaces in H(2). The stratum H(2) has recently 
received much attention f jEsMaScj . [Ha| . |McTl IMc3l IMcl] . jHT|). 

Square-tiled surfaces in H(2) are of two types |Zoj . the one-cylinder 
ones and the two-cylinder ones. The corresponding coordinates are: for 
one-cylinder surfaces, one height, three lengths of saddle connections 
and one twist parameter; for two-cylinder surfaces, one height, width 
and twist for each cylinder. 

Theorem [X] says that for each odd n ^ 5, primitive n-square-tiled 
surfaces are in two orbits A n and B n . These orbits are distinguished 
by a simple invariant, the number of integer Weierstrass points (i.e. 
Weierstrass points located at vertices of the square tiles). A surface is 
in A n if it has one integer Weierstrass point, in B n if it has three. 
The coordinates for square-tiled surfaces in Ti{2) were used in |Zoj . 
EsMaScj and in |HLj where the position of Weierstrass points was 



m 



also discussed and the invariant introduced. This invariant was inde- 
pendently expressed in terms of divisors by Kani |Kaj . McMullen |Mc4 
expressed it as the parity of a spin structure. 
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Notation. Denote by /12, wi, W2, £2) 

the two- cylinder surface with cylinders q of 
height /ij, width u>j and twist ij, with w\ < w 2 . 

The figure shows a fundamental polygon for 
5(2,3,3,8,2,1); the surface is obtained from 
this polygon by identifying pairs of parallel 
sides of same lengths. We indicate the dou- 
ble zero by black dots and the other Weierstrass points by circles. The 
same conventions hold for all pictures in this paper. 

Let us give some examples of square-tiled surfaces in Tt(2). 

First, some one-cylinder surfaces of particular interest. 

Lemma 2.3. For each n ^ 4, there is a primitive n-square-tiled surface 
which is one- cylinder both horizontally and vertically. 

The one-cylinder surface with saddle connections 1 n _ 3 2 
of lengths 1, n — 3, 2 on the top and 2, n — 3, 1 on 
the bottom has this property. 

Corollary 2.4. The stabiliser of this surface contains (01) an d (n 1 ) ■ 

Indeed, one-cylinder cusps have width n. 
Remark. When n is odd, the surface described above is in orbit B n . 

Some two-cylinder surfaces also deserve special attention. 

Notation. For a and 6^2, denote by ± 
L(a, b) the surface S(a— 1, 1, 1, b, 0, 0). This 
surface is a primitive square-tiled surface 
tiled by n = a + b — 1 squares. This surface 
has cusp width b and vertically a. 

When n is odd, this surface is in A n if a * 5 ^ 

and b are even, in B n if a and b are odd. 

2.3. Congruence subgroups; level of a subgroup. The material 
in this section is classical, and can be found in |Raj . 

For any integer m > 1, consider the natural projection SL(2, Z) — ► 
SL(2, Z/mZ). This projection is a group homomorphism. Its kernel is 
called the principal congruence subgroup of level m, and denoted 
by r(m). It consists in all matrices congruent to (01) modulo m. This 
is consistent with the notation T(l) for SL(2, Z). 



Lemma 2.5. For any m, [r(l) : r(m)] = m 3 n p |m^ 
Corollary 2.6. IfmAm' = l, then [T(m) : T{mm')\ = [T(l) : T(m')]. 
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Any group T containing some T(m) is called a congruence sub- 
group, and its level is defined to be the least m such that T(m) C T 
(i.e. the level of the largest principal congruence subgroup it contains). 

Remark. A principal congruence subgroup is a normal subgroup of 
T(l). Hence being a congruence subgroup is invariant by conjugation 
in SL(2, Z); the level is also invariant. 

There is a more general notion of level, due to Wohlfahrt |Woj . The 
level of a finite-index subgroup of SL(2, Z) is the least common multi- 
ple of its cusp widths. Wohlfahrt proved that for congruence subgroups, 
it coincides with the previous definition, and that: 

Lemma 2.7 (Wohlfahrt |Woj ) . A finite-index subgroup of level £ is a 
congruence subgroup if and only if it contains the principal congruence 
subgroup of level i. 

2.4. Quasi-modular forms. As said in the introduction, the gener- 
ating function for the weighted countings of surfaces tiled by n squares 
is a quasi-modular form. 

The numbers h n ^ c of surfaces tiled by n squares in a given stratum, 
and the numbers h v nc of primitive ones, are related by 

_ hn,c = I2d\n (7 ( n / d ) h d,c> 

where a{k) = J2d\k d * s ^ ne sum °f divisors of k. This is because the 
number of tori tiled by n squares is a(n). 

In addition, we note that in T~C(2), the coverings have no automor- 
phisms, hence the weighted and unweighted countings are the same. 

Conjecture 2. In 7^(2), the countings for odd n according to the in- 
variant are generated by a quasi-modular form. 

Theorem IE! is mentioned in |EsMaSc] as a consequence of the quasi- 
modularity. Likewise, Conjecture [T] would follow from Conjecture 121 
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3. Strategy for the proof of Theorem [T] 

We build on the proof by Schmithiisen |Schmij that the stabiliser of 
a 4-square-tiled surface in TC{2) is a noncongruence subgroup, based on 
an idea of Stefan Kiihnlein. 



3.1. Sufficient conditions for noncongruence. r(l) SL(2 Z 
Let T be a subgroup of T(l) of finite index d and 
level £. For any divisor m of £, consider the finite- 
index inclusions represented on the figure. 



d' 



r(m) 



Two remarks. First, if T projects surjectively rnr(m) 5 
to SL(2, Z/mZ), one can conclude by observing 
the two exact sequences below that dl = d, where T(£) 
d! = [r(m) : T n r(m)] and d = [T{1) : T]. 

I r(m) ^ r(l) SL(2,Z/mZ) s~ 1 

II ] d ' y 11 II 

1 — r n r(m) ^ r sl(2, z/mZ) — > 1 

Second, if V is a congruence subgroup, and hence by Lemma 12.71 
contains T(£), then Y{£) is contained in mr(m) and the indices satisfy 
[r(m) : Y{£)\ = [Tim) : mr(m)]-[Tnr(m) : T(£)}, which implies d' \ 5. 

Combining these two remarks, we get the following sufficient condi- 
tion for noncongruence, which was used by Schmithiisen jSchmij . 

Proposition 3.1 (Kiihnlein). IfT is a subgroup o/T(l) of finite index 
d and level I and there exists a divisor m of £ for which 

• T projects surjectively to SL(2, Z/mZ), and 

• the index 5 = [T(m) : T(£)} is not a multiple of d, 
then T is not a congruence subgroup. 

Remark. Suppose Y contains two matrices ( J 1 ) an d ( y \ ) ■ If m is an 
integer relatively prime to both k and k', then k and k' are invertible 
modulo m so some powers of ( J \ ) and ( ^ ° ) project to ( J } ) and ( } ? ) 
in SL(2, Z/mZ), hence the projection V — > SL(2, Z/mZ) is surjective. 

This extra remark yields the following sufficient condition for non- 
congruence. 

Proposition 3.2. If a subgroup T C T(l) of finite index d contains two 
matrices ( J \ ) and (l> 1) and if its level £ has a divisor m relatively 
prime to both k and k! , such that the index 5 = [T(m) : T(£)] is not a 
multiple of d, then V is not a congruence subgroup. 



NONCONGRUENCE SUBGROUPS IN U{2) 



3.2. Strategy. Consider an orbit A n , B n or C n , with n as in Theo- 
rem [T] Its stabiliser T^, T Bn or T Cn is defined only up to conjugation 
in SL(2, Z); the representatives of the conjugacy class are the stabilis- 
ers of the (square-tiled) surfaces in the orbit. The index and level are 
preserved by conjugation in SL(2, Z). 

Choice. Let S be a (square-tiled) surface in an orbit A n , B n or C n , 
and r be its stabiliser. 

Notation. Denote by d the index of V and by £ its level. Consider 
the prime factor decompositions n = Y[p u an d £ = YlP X > where v and 
A can denote a different integer for each prime p. 

Choice. Choose some (Ji) an d i n T, for instance k and k' 

could be taken to be the horizontal and vertical cusp widths of S. 

Notation. Following [Mc3], if a and b are two integers, denote by 
ajjb the greatest divisor of a that is prime to b. If a = Y[p a is the 
prime factor decomposition of a, we have a//b = Yl p \bP a = a l Y\ p \bP a - 

Choice. Choose m = £//kk' = 1/ Yl P \kk'P X - 

Notation. Denote by 5 the index of T(£) in T(m). 

By construction m is a divisor of £, relatively prime to both k and 
k' . In view of applying Proposition 13.21 there remains only to check 
that d does not divide 5. Since m is also relatively prime to £/m, by 
Corollary^ 5 = {£/mf [T^/Jl - £). 

Remark. If a is an integer and a = Y[p a is its prime factor decompo- 
sition, one can rewrite a r Y[ P \ a (^ ~ ^) as Y[ P \ a P ra ~ 2 (P 2 — -0- Hence 

• 6 = Yl P \kk>P 3X ~ 2 (P 2 ~ 1), an d 

• d = f(n) U P \nP 2u ~ 2 (P 2 where f( n ) is one of ^(^- 1 )> ^(«-3), 
|(n — 2), according to whether orbit A n , _E> n or C n is under considera- 
tion. 

In order to complete the proof, there merely remains to describe how 

to apply our strategy. 

For this we need the levels of T^ n , Tb„ and Tc n ', we give them in §0] 
The last three sections then describe, in each orbit, good choices of 

a surface S, values of k and k', and, keeping the notations (d, £, u, A, 

m, 5) introduced here (and consistent with those in § 13. 1J) . show that d 

does not divide 5. 
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4. The level of T a , r B and T c 

As said above, the stabiliser of an SL(2, Z)-orbit of square-tiled sur- 
faces is defined up to conjugacy in SL(2, Z), but its level is well-defined. 

Proposition 4.1. The groups T^ n; Tb„ and Tc n have levels: 

levT An = d n , \evT Bn = d n /A, \evT Cn = d n , 
where d n = lcm(l, 2,3, ... ,n). 

Remark. The prime factor decomposition of d n is ri p <nP r where the 
exponents r are the integers such that p T ^ n < p T+1 . 

The remainder of this section is devoted to proving the proposition. 

First recall that the level of T C SL(2, Z) is defined as the least 
common multiple of the amplitudes of the cusps of T. When T is 
the stabiliser of a primitive square-tiled surface S, its cusp widths are 
equivalently the horizontal cusp widths of the surfaces in the SL(2, Z)- 
orbit of 5*. 

Recall also Lemma f2 .21 If 5* is tiled by n squares, the widths of its 
cylinders are at most n, so the level of T divides lcm(l, 2, 3, . . . , n). 

Orbit C n (for even n) contains one-cylinder surfaces, which have cusp 
width n, and, for all a and b such that a + b = n + 1 and 2 ^ a, b ^ n — 1, 
two-cylinder surfaces L(a, b), which have cusp width b. Hence, the level 
of T Cn is a multiple of, and therefore equals, lcm (1, 2,3, ... ,n). 

Orbit A n (for odd n) contains one-cylinder surfaces, 
which have cusp width n, and, for all a and b such 
that a + b = n and l^a<b^n — 1, two-cylinder 
surfaces with two cylinders of height 1 and widths a 
and b, which have cusp width lcm(a, b). Hence, the 
level of Ta„ is a multiple of, and therefore equals, lcm(l, 2, 3, ... ,n). 

Orbit B n (for odd n) contains one-cylinder surfaces, which have cusp 
width n, and, for all odd a and b such that a + b = n + 1 and 2 ^ a, b ^ 
Ti — 1, two-cylinder surfaces L(a,b), which have cusp width b. Hence, 
the level of Tb„ is a multiple of lcm(l, 3,5, ... ,n). 

Since lcm(l, 2, 3, . . . , n) is a power of 2 times lcm(l, 3, 5, . . . , n), there 
remains only to determine the power of 2 in the level of r# n , i.e. the 
maximal power of 2 that can arise as a divisor of for the height h 
and the width w of a cylinder of a surface of B n . 

Let t be the integer such that 2 T < n < 2 T+1 . 

There is at least one two-cylinder surface S(hi, 2, W\, 2 T_1 , t\, t 2 ) with 
odd t 2 in B n ; such a surface satisfies = 2 T ~ 2 . 

Suppose a surface S in B n has even cusp width k = 2 t -q with q 
odd. Then 5 has two cylinders, and by the discussion in \BL[ §5.1], 
one cylinder has even width w and even height h, while the other 
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has odd height hi and odd width w'. Since k = lcm(^^-, J? h , ) and 
—ttu is odd, 2* divides -r^—. But h ^ 2 and since n = /iw + /i'-u/, 

w'Ah' ' ftAui ' 

w <n/h^ n/2 < 2 T , so ^ ^ w/2 < 2 T_1 . Therefore i sC r - 2. 

5. NONCONGRUENCE OF T c „ FOR EVEN n ^ 4 

5.1. Case when n — 2 is not a power of 2. We take S to be the 
one-cylinder surface with saddle connections of lengths 1, n — 3, 2 on 
the top and 2, n — 3, 1 on the bottom. 

1 n - 3 2 

'I 1 I m EH 



2 n - 3 1 

As a one-cylinder surface it has cusp width k = n and since its 
vertical direction is also one-cylinder, its vertical cusp width k! is also 
n, so T contains (J") and ( \ ° ) • 

Recall that V has index d = |(n - 2) Y[ p \ n p 2v ~ 2 {p 2 - 1). 
Choosing m = £//n = rip|nP A leads to 5 = Yl p \ n p 3X ~ 2 (p 2 — 1)- 
So d divides 5 if and only if 3(n — 2) divides 2 3 - rip|nP 3A ~ 2iy - 
Since n A (n — 2) = 2, the assumption that n — 2 is not a power of 2 
implies it has some (odd) prime factors that do not divide n. 

Hence d does not divide 5, so T cannot be a congruence subgroup. 

5.2. Case when n — 2 is a power of 2. The case n = 4 is known 
from [Schmij . It can also be treated as above, since the index of Tc\ is 



c 






t 


1 






< > 



d = 9 and, taking 5 and m as above, 5 = 2 4 -3. 

From now on assume n > 4. yT~^ 
We take S = S(l, 1,1, n- 2, 1,0). 
Note that this requires that n — 2 > 2, which 
is why the case n = 4 was dealt with separately. 

This surface has horizontal cusp width n — 2 and vertical cusp width 
4, so the stabiliser V contains ( \ n \ 2 ) and ( \ 5 ) . 

Recall that V has index d = §(n - 2) Yl p \ n p 2l, ~ 2 {p 2 - 1). 
Choosing m = £//2 = £/2 A leads to 5 = 2 3A ~ 2 (2 2 - 1) = 2 3A - 2 -3. 
Since n is even, it has p = 2 as a prime factor, which gives 3 as p 2 — 1, 
so 3 2 divides d. 

Hence d does not divide 5, so T cannot be a congruence subgroup. 
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6. NONCONGRUENCE OF T A FOR ODD n ^ 5 

6.1. Case when n — 1 is a power of 2. Take S = L(2,n — 1). 
1 

2 



>o< 




o 
















o 

















n-1 

Its cusp width is n — 1 (= 2 A ) and its vertical cusp width is 2, so its 

stabiliser V contains (g n \ l ) and (2 ?)■ 
Hered= A( n _i) rip|nP 2,-2 (p 2_ 1) 

The choice of m = £//2 = £/2 x leads to 5 = 2 3A - 2 -3. 

If n is a power of 3, then 3 3 divides d; otherwise n has some (odd) 
prime factor p 7^ 3, for which p 2 — 1 = {p — l)(p + 1) is a multiple of 
3, so that 3 2 divides d. Therefore d does not divide 5 and V is not a 
congruence subgroup. 

6.2. Case when n — 1 is not a power of 2. Here we take the surface 
5 = 5(n-2,l,l,2,0,l). This surface is (JJ)-L(n- 1,2). 

The cusp width of 5 is 2, and 5 has one vertical cylinder, 
hence vertical cusp width n. So Y contains (of) and ( \ \ ) . 

Hered=^(n-l)n p |„P 2 ^ 2 (p 2 -l). 
The choice of m = £//2n = e/(2 x Yl p]n p x ) leads to 5 = 

2 3A - 2 -3-n P ,nP 3A -v-i)- 

It follows that d divides 5 if and only if (n — 1) divides 

2 3A+2 -n P i„p 3A - 2 ^ 

Since n is not some 2 k + 1, n — 1 has odd prime factors; these do not 
divide n, so d does not divide 5 and T is not a congruence subgroup. 



7. NONCONGRUENCE OF Y Bn FOR ODD 71 ^ 5 

7.1. A proof for most cases. Consider the one-cylinder surface S 1 
having saddle connections of lengths 1, n — 3, 2 on the top and 2, n — 3, 
1 on the bottom. 

1 rc-3 2 



2 n-3 1 

The stabiliser of this surface contains (J") and ( * ° ) . 
Hererf=^(n-3)n p |„^- 2 (p 2 -l). 
The choice of m = ijjn leads to 5 = Tl p \ n P 3X ~ 2 (p 2 — 1)- 
Thus d divides 5 if and only if 3(n — 3) divides 16 ri P |nP : 
Call an odd n ^ 5 "bad" if 3(n - 3) divides 16 n p i„P 3A_: 
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As we are about to see, this is very rare, so that for "most" odd 
n ^ 5, d does not divide S. 



7.2. The bad case. If n is such that 3(n — 3) divides 16n p | n P 3A 2l ' i 

• n — 3 is not a multiple of 2 5 ; 

• n is a multiple of 3 (and hence (n — 3) A n = 3); 

• all odd prime factors of n — 3 divide n. 

Combining these three remarks, we see the bad case is when n — 3 
is of the form 2 r -3 s with 1 ^ r ^ 4 and 1 ^ s. 

Thus the bad case consists of the four sequences n r>s = 2 r -3 s + 3 
for r = 1 to 4 and s ^ 1, which have exponential growth, hence zero 
density. 

In particular, the discussion in § 17. II proves the noncongruence of T Bn 
when n is out of these four sequences. 



7.3. First bad cases. Here we examine the first element of each of the 
four sequences, i.e. n G {9, 15,27,51}. We include the second element 
of the first sequence, i.e. n — 21. 

Take S = L(5,n — 4). Its horizontal \ 
cusp width is n — 4 and its vertical cusp 
width is 5, so its stabiliser T contains 
U n T 4 )andQ?). 

Here d = &(n - 3)n 2 Yl p \ n (l ~ £)• < 

Choosing m = £//5(n — 4) leads to 

The values of d and 5 for n G {9, 15, 21, 27, 51} are: 



n 


9 


15 


21 27 51 


d 


3 4 


2 4 -3 3 


2 4. 3 4 2 2. 3B 2 S. 3 4 


5 


2 3 -3-5 


2 6 -3 2 -5 2 -ll 


2 8 -3 3 -5-17 2 7 -3 2 -5 4 -ll-23 2 8 -3 2 -5 4 -23-47 



In each case, we see by observing the power of 3 in d and S that d 
does not divide 5. 



7.4. Remaining bad cases. Here we will consider two surfaces Si 
and 5*2 in orbit B n , and for each Si find some ki and k[ such that ( J ^ ) 
and (fe( i) are in the stabiliser Tj of Si (i G {1, 2}). The groups Ti and 
T 2 , being conjugate, have the same index d in T(l) and the same level 
I. Using rrii = £//kik'i will yield a 5i for each i G {1,2} and we will 
show that d cannot divide both Si and $2, implying that Tb„ is not a 
congruence subgroup. 
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1 



1 A 



Take S x = 5(1, 2 r , 3, 3 s , 1, 0). 

Its stabiliser contains (J* 1 ) an d (fc'i)> 
with jfei = 3 s and k[ = 2 r -(2 r -3 + 3). Note that 
here k[ is not the exact vertical cusp width of 
Si, but a multiple of it. For r = 1, 2, 3, 4, the 
value of k[ is respectively 2-3 2 , 2 2 -3-5, 2 3 -3 3 , 
2 4 -3-17. 

Take 5 2 = 5(3, 2 r , 1, 3 s , 0, 0). 

Its stabiliser contains (g^ 2 ) an d (4°)' 
with k 2 = 3 s and fc^ = 2 r -(2 r + 3); again k' 2 is 
not the exact vertical cusp width, but a mul- 
tiple of it. It equals 2-5, 2 2 -7, 2 3 -ll, 2 4 -19, 
respectively for r = 1, 2, 3, 4. 

Recall that n = 2 r -3 s + 3, with s ^ 2. 

Here, d = £(n - 3)n 2 n p | n (l - £). Since :r 
3 2 divides (n — 3), it does not divide n. Hence we can rewrite d 

2 r-l. 3 s + l+2u-2 p>v-*(f - 1). 

The choice of rrii = if/k^ leads to 5, = Yl ]k p 3X ~ 2 (p 2 — ]_). 
Given the values of p 2 — 1 for p e {2, 3, 5, 7, 11, 17, 19} (cf. table), 



)0< 








































-e- 








— e 


5 — 
















t 


i 









p 



2 3 



7 



11 



1 3 2F 2 3 -3 2 4 -3 2 s -3-5 



17 

"2^" 



19 



2 3 -3 2 -5 



the prime factors of 5% and 5 2 for each r G {1,2,3, 4} are: 



r 


1 2 


3 4 


Si 


2,3 2,3,5 


2,3 2,3,17 


s 2 


2,3,5 2,3,7 


2,3,5,11 2,3,5,19 



If d divides 5i and 5%, we deduce that n p |^P 2iy 2 i.P 2 ~ 1) can have 
only 2 and 3 as prime factors. If this is the case, then n has no square 
factor, and, by Lemma ED (postponed to the end of the section), its 
prime factors are in {3,5,7,17}. The integers of the form 3-5 a -7 fe -17 c 
with a,b,ce {0, 1} are 3, 15, 21, 51, 105, 255, 357, 885. The only bad 
ones are 15, 21, and 51, and these were dealt with in § 17.31 

To complete the proof of Theorem ^ there remains only to prove: 

Lemma 7.1. If p is prime and p 2 — 1 has no other prime factors than 
2 and 3, then p G {2, 3, 5, 7, 17}. 

This follows from the fact that 8 and 9 are the only two consecutive 
nontrivial powers, a famous long-standing conjecture that was recently 
proved by Mihailescu |Mij . 
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Theorem D (Catalan's Conjecture). The equation 

x u - y v = 1, X > 0, y > 0, it > 1, w > 1 
/ias no other integer solution than x u = 3 2 , y v = 2 3 . 

Proof of the lemma. By Catalan's Conjecture, consecutive powers of 2 
and 3 are: (1, 2); (2, 3); (3, 4); (8, 9). Suppose (p - l)(p + 1) has no 
other prime factors than 2 and 3. If p is odd, then exactly one of p — 1, 
p + 1 is a multiple of 4, and the other one is 2-3 a . If = 3 a , then 
either a = 0, and p = 3, or a — 1, and p = 7. If ^ = 3 a , then either 
a — 1, and p = 5, or a = 2, and p = 17. □ 
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